Skip to content

Enable trace in OperatorSequence - #178

Open
andrej wants to merge 10 commits into
amd:develfrom
andrej:trace-buffer-from-compiler
Open

Enable trace in OperatorSequence#178
andrej wants to merge 10 commits into
amd:develfrom
andrej:trace-buffer-from-compiler

Conversation

@andrej

@andrej andrej commented Aug 31, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Requires upstream MLIR-AIE PR Xilinx/mlir-aie#3652

Supersedes #154

asyms and others added 9 commits August 26, 2026 09:52
@asyms
require the stream-dse release that generates mlir-aie 1.4.0 buffer d…
1478cbe 
…escriptors
@asyms
carry a hardware trace buffer through the fused sequence
aaa07b9
@asyms
patch the trace buffer address against the dispatched kernel
979f9b4 
Trace lowering records the buffer's index in the sequence it configures, but that
index is resolved against the kernel the host dispatches, which for a fused build
is the wrapper rather than the operator. The address was patched from an argument
the wrapper did not have, so the trace DMA wrote nowhere and the buffer came back
empty. Give the wrapper the buffer at the same index.
@asyms
give every traced operator its own trace buffer slot
fc25b47
@asyms
key the fused sequence artifacts on the trace size
dac0b4c 
Tracing adds a runtime-sequence argument, so a traced ELF cannot be reused by an
untraced run or the other way round: the two now get different artifact names and
toggling the flag no longer needs the build directory wiped.
@asyms
separate out tracing_utils.py and call in swiglu_prefill_stream/test.py
18b17d3
@andrej
Let the compiler place the trace buffer for a fused sequence
19b8f78 
mlir-aie appends a single trace buffer to the dispatched runtime sequence and
hands each configured design a slice of it. The fused sequence no longer has to
place one buffer per operator at the index that operator patches against.

Drop trace_argument_layout. The three consolidated buffers keep indices 0-2 and
the trace buffer lands after them, so operators taking the same number of
arguments no longer contend for one slot.

Size the host buffer from aie.trace_slices in the lowered module. trace_size is
per design and says nothing about how many channels or sub-designs claim a
share. Bind the buffer at index 3 and sync it back with the outputs.

Ask aiecc for --get-input-with-addresses on a traced build and read the lowered
module from that path, rather than picking the work-dir file with the most
write32 ops.

Split the buffer by recorded slice when dumping traces, and parse each slice
against the device that wrote it: sub-designs routinely occupy the same tiles,
and a merged parse cannot tell their events apart.
@andrej
Simplify the trace comments and docstrings
c30c332 
Rewrite in the plain style: active voice, one idea per sentence, and no
attribution of understanding to the parser.

Match the module docstring of tracing_utils to a single trace buffer. It
described one buffer per operator, which the compiler no longer produces.
@andrej
Import the trace helpers at module scope
b1a618f 
Both files already load the aie bindings at import time, so a deferred import
saves nothing.
@andrej andrej mentioned this pull request Sep 8, 2026
Open
@andrej
Split the trace buffer with mlir-aie's own parser
bf45f8f 
mlir-aie 1.4.3.dev55 carries the trace slice API this branch needs, so raise the
pin to a nightly that has it. Below that pin the module-scope import of
get_trace_slices fails, and every operator import fails with it.

parse_trace_slices splits a fused trace buffer by the recorded layout and decodes
each region against the device that wrote it, which is what dump_traces did by
hand. Call it instead. The layout helper then only serves the buffer size, so
return that and drop the slice list from the sequence callable.

Write the raw words once per dump rather than once per slice, since the parser
takes the whole buffer.
@github-actions

github-actions Bot commented Sep 8, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

CI Test Results

33b4d18 (2026_09_08_21_34_33)

IRON - CI Summary

Small

iron/operators/axpy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0] - - ✅ 411.50
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0] - - ✅ 263.06
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0] - - ✅ 554.78
iron/operators/dequant
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32] - - ✅ 259.22
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32] - - ✅ 287.76
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32] - - ✅ 720.62
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32] - - ✅ 441.76
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32] - - ✅ 371.04
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32] - - ✅ 392.22
iron/operators/elementwise_add
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 278.52
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 339.76
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 342.02
iron/operators/elementwise_mul
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 396.54
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 421.50
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 445.04
iron/operators/gelu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 439.00
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 524.84
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 414.12
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 432.72
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 406.82
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 486.28
iron/operators/gemm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 787.18
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 671.84
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 83312.88
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 25039.84
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1] - - ✅ 3602.92
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4] - - ✅ 5998.94
iron/operators/gemv
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ✅ 0.13
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ✅ 3.62
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024] - - ✅ 6.53
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512] - - ✅ 10.25
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ✅ 3.78
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024] - - ✅ 7.24
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024] - - ✅ 9.91
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2] - - ✅ 1.96
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2] - - ✅ 0.26
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4] - - ✅ 0.37
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8] - - ✅ 1.84
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ❌ -
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ❌ -
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ❌ -
iron/operators/layer_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 420.64
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 416.42
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 497.36
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 381.36
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 457.12
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 368.94
iron/operators/leaky_relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01] - - ✅ 390.40
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1] - - ✅ 367.02
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25] - - ✅ 400.06
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01] - - ✅ 351.86
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01] - - ✅ 375.32
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01] - - ✅ 487.90
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01] - - ✅ 388.66
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01] - - ✅ 443.84
iron/operators/mem_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048] - - ✅ 358.40
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024] - - ✅ 367.08
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024] - - ✅ 344.84
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512] - - ✅ 415.94
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512] - - ✅ 401.22
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256] - - ✅ 480.16
iron/operators/relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 487.92
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 429.78
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 334.98
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 434.30
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 587.34
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 520.08
iron/operators/repeat
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word] - - ✅ -
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None] - - ✅ 266.94
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64] - - ✅ 312.48
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None] - - ✅ 296.76
iron/operators/rms_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False] - - ✅ 333.20
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True] - - ✅ 335.96
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False] - - ✅ 244.74
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True] - - ✅ 410.78
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False] - - ✅ 376.28
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True] - - ✅ 425.22
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False] - - ✅ 502.70
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True] - - ✅ 429.84
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False] - - ✅ 372.68
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True] - - ✅ 433.68
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False] - - ✅ 395.74
iron/operators/rope
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0] - - ✅ 473.66
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0] - - ✅ 503.52
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0] - - ✅ 530.96
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0] - - ✅ 338.86
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0] - - ✅ 390.74
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0] - - ✅ 705.24
iron/operators/sigmoid
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 658.24
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 339.00
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 450.08
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 525.44
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 574.40
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 468.40
iron/operators/silu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 421.42
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 496.30
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 345.92
iron/operators/softmax
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024] - - ✅ 466.72
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048] - - ✅ 621.84
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 426.86
iron/operators/strided_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_strided_copy[chunked_transfer] - - ✅ 321.50
test_strided_copy[contiguous] - - ✅ 745.62
test_strided_copy[four_channels] - - ✅ 337.32
test_strided_copy[kv_slot0] - - ✅ 385.04
test_strided_copy[kv_slot5] - - ✅ 379.94
test_strided_copy[kv_slot5_four_channels] - - ✅ 345.96
test_strided_copy[kv_slot5_two_channels] - - ✅ 388.94
test_strided_copy[kv_slot_last] - - ✅ 334.60
test_strided_copy[two_channels] - - ✅ 400.26
test_strided_copy[two_channels_chunked] - - ✅ 320.48
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4] - - ✅ -
iron/operators/swiglu_decode
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584] - - ✅ 16854.88
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048] - - ✅ 14890.66
iron/operators/swiglu_prefill
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False] - - ✅ 22651.28
iron/operators/tanh
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 298.90
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 305.14
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 438.60
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 426.50
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 388.44
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 439.20
iron/operators/transpose
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1] - - ✅ 523.74
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2] - - ✅ 540.48
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1] - - ✅ 439.68
Phoenix - Small

IRON

Tested on 2026_09_08_21_34_33 at commit 33b4d18.

iron/operators/axpy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]✅ 5/5411.500.04n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]✅ 5/5263.060.05n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]✅ 5/5554.780.02n/a
iron/operators/dequant
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]✅ 5/5259.220.02n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]✅ 5/5287.760.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]✅ 5/5720.620.01n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]✅ 5/5441.760.01n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]✅ 5/5371.040.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]✅ 5/5392.220.01n/a
iron/operators/elementwise_add
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5278.520.05n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5339.760.04n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5342.020.04n/a
iron/operators/elementwise_mul
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5396.540.04n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5421.500.03n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5445.040.03n/a
iron/operators/gelu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5439.000.02n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5524.840.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5414.120.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5432.720.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5406.820.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5486.280.02n/a
iron/operators/gemm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5787.180.3715.59
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5671.840.3816.42
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/583312.880.30206.25
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/525039.841.01686.24
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]✅ 5/53602.922.60681.21
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]✅ 5/55998.940.2111.22
iron/operators/gemv
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]✅ 5/5n/a0.130.13
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]✅ 5/5n/a3.623.61
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]✅ 5/5n/a6.536.52
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]✅ 5/5n/a10.2510.24
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a3.783.78
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a7.247.24
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a9.919.90
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]✅ 5/5n/a1.961.95
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]✅ 5/5n/a0.260.25
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]✅ 5/5n/a0.370.37
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]✅ 5/5n/a1.841.81
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]❌ 0/5n/an/an/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]❌ 0/5n/an/an/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]❌ 0/5n/an/an/a
iron/operators/layer_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5420.640.02n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5416.420.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5497.360.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5381.360.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5457.120.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5368.940.02n/a
iron/operators/leaky_relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]✅ 5/5390.400.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]✅ 5/5367.020.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]✅ 5/5400.060.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]✅ 5/5351.860.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]✅ 5/5375.320.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]✅ 5/5487.900.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]✅ 5/5388.660.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]✅ 5/5443.840.02n/a
iron/operators/mem_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]✅ 5/5358.400.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]✅ 5/5367.080.03n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]✅ 5/5344.840.03n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]✅ 5/5415.940.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]✅ 5/5401.220.02n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]✅ 5/5480.160.02n/a
iron/operators/relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5487.920.02n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5429.780.02n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5334.980.03n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5434.300.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5587.340.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5520.080.02n/a
iron/operators/repeat
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]✅ 5/5n/an/an/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]✅ 5/5266.940.09n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]✅ 5/5312.480.14n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]✅ 5/5296.760.02n/a
iron/operators/rms_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]✅ 5/5333.200.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]✅ 5/5335.960.04n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]✅ 5/5244.740.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]✅ 5/5410.780.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]✅ 5/5376.280.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]✅ 5/5425.220.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]✅ 5/5502.700.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]✅ 5/5429.840.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]✅ 5/5372.680.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]✅ 5/5433.680.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]✅ 5/5395.740.02n/a
iron/operators/rope
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]✅ 5/5473.660.23n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]✅ 5/5503.520.22n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]✅ 5/5530.960.23n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]✅ 5/5338.860.24n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]✅ 5/5390.740.21n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]✅ 5/5705.240.18n/a
iron/operators/sigmoid
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5658.240.02n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5339.000.03n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5450.080.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5525.440.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5574.400.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5468.400.02n/a
iron/operators/silu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5421.420.02n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5496.300.02n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5345.920.03n/a
iron/operators/softmax
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]✅ 5/5466.720.31n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]✅ 5/5621.840.23n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5426.860.33n/a
iron/operators/strided_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_strided_copy[chunked_transfer]✅ 5/5321.500.01n/a
test_strided_copy[contiguous]✅ 5/5745.620.01n/a
test_strided_copy[four_channels]✅ 5/5337.320.01n/a
test_strided_copy[kv_slot0]✅ 5/5385.040.37n/a
test_strided_copy[kv_slot5]✅ 5/5379.940.38n/a
test_strided_copy[kv_slot5_four_channels]✅ 5/5345.960.41n/a
test_strided_copy[kv_slot5_two_channels]✅ 5/5388.940.37n/a
test_strided_copy[kv_slot_last]✅ 5/5334.600.43n/a
test_strided_copy[two_channels]✅ 5/5400.260.01n/a
test_strided_copy[two_channels_chunked]✅ 5/5320.480.01n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]✅ 1/1n/an/an/a
iron/operators/swiglu_decode
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]✅ 5/516854.880.00n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]✅ 5/514890.660.00n/a
iron/operators/swiglu_prefill
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]✅ 5/522651.280.10n/a
iron/operators/tanh
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5298.900.03n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5305.140.03n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5438.600.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5426.500.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5388.440.03n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5439.200.02n/a
iron/operators/transpose
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]✅ 5/5523.741.21n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]✅ 5/5540.482.01n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]✅ 5/5439.681.46n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.07 (+42.97%)0.04 (+11.44%)0.03 (-12.88%)0.02 (-6.44%)0.02 (+73.00%)598.00 (+6.88%)411.50 (+1.33%)484.40 (+14.79%)177.60 (-30.05%)188.40 (+34.40%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)559.50 (n/a)406.08 (n/a)422.00 (n/a)253.90 (n/a)140.18 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.05 (-15.40%)0.05 (+34.21%)0.05 (+106.44%)0.04 (+251.55%)0.00 (-82.08%)298.50 (-71.56%)263.06 (-49.09%)262.40 (-51.55%)237.60 (+18.21%)23.83 (-93.14%)
deb6e1e — 2026-09-03 22:38:330.06 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)1049.40 (n/a)516.68 (n/a)541.60 (n/a)201.00 (n/a)347.21 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (-23.63%)0.02 (-27.68%)0.02 (-29.05%)0.02 (-25.21%)0.01 (-34.19%)784.80 (+33.70%)554.78 (+33.91%)542.20 (+40.94%)333.30 (+30.91%)161.13 (+8.01%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)587.00 (n/a)414.30 (n/a)384.70 (n/a)254.60 (n/a)149.17 (n/a)
iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (-32.14%)0.02 (-12.37%)0.02 (-4.37%)0.02 (+7.30%)0.00 (-68.54%)297.50 (-6.80%)259.22 (+8.30%)253.90 (+4.57%)224.90 (+47.38%)27.65 (-55.56%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)319.20 (n/a)239.36 (n/a)242.80 (n/a)152.60 (n/a)62.22 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (+5.58%)0.02 (+11.02%)0.02 (+13.18%)0.01 (+23.00%)0.01 (-9.53%)398.90 (-18.69%)287.76 (-13.77%)238.30 (-11.68%)196.30 (-5.31%)91.68 (-30.78%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)490.60 (n/a)333.72 (n/a)269.80 (n/a)207.30 (n/a)132.45 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+1.54%)0.01 (-34.89%)0.01 (-46.16%)0.00 (-83.61%)0.01 (+227.14%)2018.30 (+509.94%)720.62 (+162.23%)484.80 (+85.75%)236.20 (-1.50%)738.65 (+1946.23%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)330.90 (n/a)274.80 (n/a)261.00 (n/a)239.80 (n/a)36.10 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (-14.87%)0.01 (+13.87%)0.01 (+27.69%)0.01 (+201.94%)0.00 (-45.15%)625.80 (-66.88%)441.76 (-44.80%)442.30 (-21.69%)286.00 (+17.45%)150.19 (-78.05%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.01 (n/a)1889.60 (n/a)800.34 (n/a)564.80 (n/a)243.50 (n/a)684.35 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+20.97%)0.02 (+8.01%)0.01 (+11.75%)0.01 (+18.56%)0.01 (+10.84%)435.40 (-15.65%)371.04 (-8.64%)432.70 (-10.53%)210.70 (-17.34%)97.75 (-22.64%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)516.20 (n/a)406.14 (n/a)483.60 (n/a)254.90 (n/a)126.36 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (-7.06%)0.01 (-1.95%)0.02 (+4.33%)0.01 (+25.91%)0.00 (-13.85%)561.00 (-20.57%)392.22 (-2.47%)316.90 (-4.14%)264.20 (+7.57%)143.92 (-23.81%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)706.30 (n/a)402.16 (n/a)330.60 (n/a)245.60 (n/a)188.89 (n/a)
iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)481.70 (n/a)278.52 (n/a)237.00 (n/a)210.40 (n/a)114.14 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.05 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)505.80 (n/a)339.76 (n/a)245.60 (n/a)230.40 (n/a)136.80 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)491.20 (n/a)342.02 (n/a)297.60 (n/a)223.60 (n/a)119.77 (n/a)
iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.05 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)598.20 (n/a)396.54 (n/a)383.40 (n/a)238.70 (n/a)160.68 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.06 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)570.20 (n/a)421.50 (n/a)505.60 (n/a)220.10 (n/a)162.13 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)503.40 (n/a)445.04 (n/a)448.10 (n/a)363.00 (n/a)53.33 (n/a)
iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)679.40 (n/a)439.00 (n/a)508.20 (n/a)199.80 (n/a)198.56 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1056.30 (n/a)524.84 (n/a)447.20 (n/a)256.40 (n/a)313.61 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.05 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)553.30 (n/a)414.12 (n/a)458.30 (n/a)168.80 (n/a)159.88 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)594.50 (n/a)432.72 (n/a)506.90 (n/a)209.10 (n/a)168.62 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)572.70 (n/a)406.82 (n/a)429.90 (n/a)219.00 (n/a)131.28 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)539.00 (n/a)486.28 (n/a)507.50 (n/a)395.90 (n/a)59.18 (n/a)
iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.47 (-28.53%)0.37 (-21.23%)0.41 (-4.41%)0.12 (-67.69%)0.14 (+23.06%)1855.20 (+209.56%)787.18 (+58.68%)541.00 (+4.60%)468.40 (+39.90%)597.87 (+506.61%)20.15 (-28.53%)15.59 (-21.23%)17.44 (-4.41%)5.09 (-67.69%)5.98 (+23.06%)
deb6e1e — 2026-09-03 22:38:330.66 (n/a)0.46 (n/a)0.43 (n/a)0.37 (n/a)0.11 (n/a)599.30 (n/a)496.08 (n/a)517.20 (n/a)334.80 (n/a)98.56 (n/a)28.19 (n/a)19.79 (n/a)18.25 (n/a)15.75 (n/a)4.86 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.51 (-8.90%)0.38 (-8.33%)0.43 (+2.92%)0.17 (-50.15%)0.13 (+46.60%)1315.10 (+100.63%)671.84 (+23.24%)509.50 (-2.82%)436.30 (+9.79%)364.99 (+235.82%)21.63 (-8.90%)16.42 (-8.33%)18.52 (+2.92%)7.18 (-50.15%)5.61 (+46.60%)
deb6e1e — 2026-09-03 22:38:330.56 (n/a)0.42 (n/a)0.42 (n/a)0.34 (n/a)0.09 (n/a)655.50 (n/a)545.14 (n/a)524.30 (n/a)397.40 (n/a)108.69 (n/a)23.74 (n/a)17.91 (n/a)18.00 (n/a)14.40 (n/a)3.83 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.31 (+0.19%)0.30 (-0.40%)0.30 (-1.46%)0.30 (+0.05%)0.00 (-1.01%)84399.10 (-0.05%)83312.88 (+0.40%)83969.60 (+1.48%)81531.10 (-0.19%)1252.62 (-1.21%)210.72 (+0.19%)206.25 (-0.40%)204.60 (-1.46%)203.56 (+0.05%)3.13 (-1.01%)
deb6e1e — 2026-09-03 22:38:330.31 (n/a)0.30 (n/a)0.30 (n/a)0.30 (n/a)0.00 (n/a)84441.40 (n/a)82982.52 (n/a)82742.70 (n/a)81682.30 (n/a)1268.00 (n/a)210.33 (n/a)207.07 (n/a)207.63 (n/a)203.45 (n/a)3.16 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:491.02 (-0.32%)1.01 (-0.76%)1.01 (-0.85%)0.98 (-1.60%)0.02 (+56.44%)25661.30 (+1.62%)25039.84 (+0.78%)25012.30 (+0.86%)24624.30 (+0.33%)406.12 (+59.26%)697.68 (-0.32%)686.24 (-0.76%)686.86 (-0.85%)669.49 (-1.60%)11.04 (+56.43%)
deb6e1e — 2026-09-03 22:38:331.03 (n/a)1.01 (n/a)1.01 (n/a)1.00 (n/a)0.01 (n/a)25251.20 (n/a)24846.02 (n/a)24799.50 (n/a)24544.40 (n/a)255.00 (n/a)699.95 (n/a)691.51 (n/a)692.75 (n/a)680.36 (n/a)7.06 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:493.87 (+5.84%)2.60 (-8.15%)2.29 (-21.75%)1.37 (-30.09%)1.08 (+28.38%)5898.70 (+43.03%)3602.92 (+17.07%)3522.30 (+27.80%)2081.80 (-5.51%)1565.94 (+62.78%)1015.45 (+5.84%)681.21 (-8.15%)600.15 (-21.75%)358.37 (-30.09%)283.09 (+28.38%)
deb6e1e — 2026-09-03 22:38:333.66 (n/a)2.83 (n/a)2.92 (n/a)1.95 (n/a)0.84 (n/a)4124.00 (n/a)3077.52 (n/a)2756.20 (n/a)2203.30 (n/a)962.01 (n/a)959.42 (n/a)741.61 (n/a)766.98 (n/a)512.59 (n/a)220.50 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.23 (-6.85%)0.21 (+0.77%)0.21 (-0.61%)0.20 (+10.37%)0.01 (-53.51%)6341.60 (-9.39%)5998.94 (-1.77%)5962.10 (+0.61%)5513.20 (+7.35%)346.36 (-55.02%)12.17 (-6.85%)11.22 (+0.77%)11.26 (-0.61%)10.58 (+10.37%)0.66 (-53.51%)
deb6e1e — 2026-09-03 22:38:330.24 (n/a)0.21 (n/a)0.21 (n/a)0.18 (n/a)0.03 (n/a)6999.10 (n/a)6106.98 (n/a)5925.70 (n/a)5135.70 (n/a)770.08 (n/a)13.07 (n/a)11.13 (n/a)11.33 (n/a)9.59 (n/a)1.42 (n/a)
iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.20 (n/a)0.13 (n/a)0.13 (n/a)0.06 (n/a)0.05 (n/a)0.20 (n/a)0.13 (n/a)0.12 (n/a)0.06 (n/a)0.05 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:493.79 (n/a)3.62 (n/a)3.68 (n/a)3.41 (n/a)0.16 (n/a)3.79 (n/a)3.61 (n/a)3.67 (n/a)3.41 (n/a)0.16 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:497.44 (+0.50%)6.53 (+1.23%)6.04 (-9.76%)5.74 (+1.45%)0.84 (+10.49%)7.44 (+0.50%)6.52 (+1.23%)6.04 (-9.76%)5.74 (+1.45%)0.84 (+10.49%)
deb6e1e — 2026-09-03 22:38:337.41 (n/a)6.45 (n/a)6.69 (n/a)5.66 (n/a)0.76 (n/a)7.40 (n/a)6.44 (n/a)6.69 (n/a)5.66 (n/a)0.76 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:4914.17 (+39.68%)10.25 (+16.98%)9.30 (+9.51%)8.04 (-2.02%)2.65 (+237.26%)14.16 (+39.68%)10.24 (+16.98%)9.30 (+9.51%)8.03 (-2.02%)2.64 (+237.26%)
deb6e1e — 2026-09-03 22:38:3310.15 (n/a)8.76 (n/a)8.50 (n/a)8.20 (n/a)0.78 (n/a)10.14 (n/a)8.75 (n/a)8.49 (n/a)8.20 (n/a)0.78 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:493.89 (n/a)3.78 (n/a)3.77 (n/a)3.65 (n/a)0.09 (n/a)3.89 (n/a)3.78 (n/a)3.77 (n/a)3.65 (n/a)0.09 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:497.63 (+1.91%)7.24 (+9.39%)7.38 (+13.15%)6.80 (+17.84%)0.41 (-37.39%)7.63 (+1.91%)7.24 (+9.39%)7.38 (+13.15%)6.79 (+17.84%)0.41 (-37.39%)
deb6e1e — 2026-09-03 22:38:337.49 (n/a)6.62 (n/a)6.52 (n/a)5.77 (n/a)0.66 (n/a)7.49 (n/a)6.62 (n/a)6.52 (n/a)5.77 (n/a)0.66 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:4914.26 (+1.46%)9.91 (-20.99%)8.59 (-37.46%)8.21 (+9.40%)2.52 (-10.54%)14.25 (+1.46%)9.90 (-20.99%)8.58 (-37.46%)8.21 (+9.40%)2.52 (-10.54%)
deb6e1e — 2026-09-03 22:38:3314.05 (n/a)12.54 (n/a)13.73 (n/a)7.51 (n/a)2.82 (n/a)14.05 (n/a)12.54 (n/a)13.72 (n/a)7.50 (n/a)2.82 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:493.02 (-4.00%)1.96 (-22.23%)1.78 (-41.49%)1.04 (-4.80%)0.91 (+2.85%)3.02 (-4.00%)1.95 (-22.23%)1.77 (-41.49%)1.03 (-4.80%)0.91 (+2.85%)
deb6e1e — 2026-09-03 22:38:333.15 (n/a)2.52 (n/a)3.04 (n/a)1.09 (n/a)0.89 (n/a)3.14 (n/a)2.51 (n/a)3.03 (n/a)1.09 (n/a)0.89 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.55 (-3.09%)0.26 (-31.28%)0.28 (-20.20%)0.08 (+0.07%)0.20 (-1.12%)0.54 (-3.09%)0.25 (-31.28%)0.27 (-20.20%)0.08 (+0.07%)0.19 (-1.12%)
deb6e1e — 2026-09-03 22:38:330.57 (n/a)0.37 (n/a)0.35 (n/a)0.08 (n/a)0.20 (n/a)0.56 (n/a)0.37 (n/a)0.34 (n/a)0.08 (n/a)0.20 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:490.63 (-12.77%)0.37 (-9.57%)0.37 (-20.74%)0.08 (+3.79%)0.20 (-15.82%)0.63 (-12.77%)0.37 (-9.57%)0.36 (-20.74%)0.08 (+3.79%)0.20 (-15.82%)
deb6e1e — 2026-09-03 22:38:330.73 (n/a)0.41 (n/a)0.46 (n/a)0.08 (n/a)0.24 (n/a)0.72 (n/a)0.41 (n/a)0.46 (n/a)0.08 (n/a)0.24 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
33b4d18 — 2026-09-08 21:29:492.06 (-16.52%)1.84 (+16.22%)1.88 (+6.01%)1.48 (+234.72%)0.21 (-72.00%)2.03 (-16.52%)1.81 (+16.22%)1.85 (+6.01%)1.46 (+234.72%)0.21 (-72.00%)
deb6e1e — 2026-09-03 22:38:332.47 (n/a)1.58 (n/a)1.78 (n/a)0.44 (n/a)0.76 (n/a)2.43 (n/a)1.55 (n/a)1.75 (n/a)0.43 (n/a)0.75 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)647.90 (n/a)420.64 (n/a)436.30 (n/a)255.70 (n/a)155.52 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)530.80 (n/a)416.42 (n/a)427.90 (n/a)239.30 (n/a)110.16 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)744.50 (n/a)497.36 (n/a)485.30 (n/a)315.20 (n/a)168.24 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)504.30 (n/a)381.36 (n/a)358.10 (n/a)291.50 (n/a)90.00 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)661.40 (n/a)457.12 (n/a)460.80 (n/a)269.70 (n/a)160.97 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)613.70 (n/a)368.94 (n/a)341.60 (n/a)265.80 (n/a)142.93 (n/a)
iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (+5.22%)0.02 (+11.43%)0.02 (+45.41%)0.02 (+12.42%)0.01 (-10.27%)527.30 (-11.03%)390.40 (-13.61%)357.10 (-31.23%)240.60 (-4.94%)125.82 (-22.54%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)592.70 (n/a)451.90 (n/a)519.30 (n/a)253.10 (n/a)162.42 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (+7.82%)0.02 (+14.12%)0.02 (+49.68%)0.02 (+12.07%)0.01 (-0.93%)519.80 (-10.78%)367.02 (-13.78%)330.60 (-33.19%)240.60 (-7.25%)130.75 (-13.01%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)582.60 (n/a)425.66 (n/a)494.80 (n/a)259.40 (n/a)150.31 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-21.10%)0.02 (-16.71%)0.02 (-29.72%)0.02 (-0.96%)0.01 (-32.92%)490.90 (+0.97%)400.06 (+15.23%)432.50 (+42.27%)276.30 (+26.74%)99.83 (-16.97%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)486.20 (n/a)347.18 (n/a)304.00 (n/a)218.00 (n/a)120.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+14.30%)0.03 (+20.74%)0.02 (+13.54%)0.02 (+0.71%)0.01 (+36.39%)487.50 (-0.71%)351.86 (-14.77%)388.50 (-11.92%)231.20 (-12.49%)106.04 (+17.81%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)491.00 (n/a)412.84 (n/a)441.10 (n/a)264.20 (n/a)90.01 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-41.58%)0.02 (-0.25%)0.03 (+58.46%)0.01 (-7.31%)0.01 (-50.10%)593.80 (+7.89%)375.32 (-9.78%)289.90 (-36.90%)262.80 (+71.21%)148.60 (-4.21%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)550.40 (n/a)416.02 (n/a)459.40 (n/a)153.50 (n/a)155.14 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+20.36%)0.02 (+5.23%)0.02 (+12.53%)0.01 (-19.93%)0.00 (+141.97%)733.30 (+24.90%)487.90 (-0.48%)420.50 (-11.12%)374.00 (-16.91%)143.57 (+157.41%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)587.10 (n/a)490.24 (n/a)473.10 (n/a)450.10 (n/a)55.77 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (+4.41%)0.02 (+33.88%)0.02 (+20.84%)0.02 (+273.15%)0.01 (-27.26%)541.00 (-73.20%)388.66 (-48.88%)419.60 (-17.25%)239.50 (-4.24%)115.55 (-83.80%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)2018.90 (n/a)760.24 (n/a)507.10 (n/a)250.10 (n/a)713.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+45.24%)0.02 (+22.66%)0.02 (+15.79%)0.01 (+4.72%)0.01 (+79.81%)597.00 (-4.51%)443.84 (-13.50%)463.40 (-13.63%)213.00 (-31.13%)143.04 (+9.12%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)625.20 (n/a)513.10 (n/a)536.50 (n/a)309.30 (n/a)131.08 (n/a)
iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-7.04%)0.02 (-6.99%)0.02 (-21.14%)0.02 (+19.75%)0.01 (-8.83%)454.70 (-16.49%)358.40 (+5.24%)394.40 (+26.82%)239.00 (+7.56%)94.16 (-22.25%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)544.50 (n/a)340.56 (n/a)311.00 (n/a)222.20 (n/a)121.11 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+18.69%)0.03 (+4.23%)0.02 (-12.25%)0.01 (-7.73%)0.01 (+23.67%)584.00 (+8.37%)367.08 (-0.31%)384.00 (+13.98%)196.80 (-15.72%)157.81 (+10.73%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)538.90 (n/a)368.22 (n/a)336.90 (n/a)233.50 (n/a)142.52 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-9.94%)0.03 (+6.79%)0.02 (+44.06%)0.02 (+23.16%)0.01 (-40.63%)476.50 (-18.81%)344.84 (-16.53%)347.90 (-30.57%)238.50 (+11.03%)93.09 (-45.74%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)586.90 (n/a)413.14 (n/a)501.10 (n/a)214.80 (n/a)171.55 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-13.00%)0.02 (-30.56%)0.02 (-41.97%)0.01 (-26.72%)0.01 (+13.43%)598.60 (+36.45%)415.94 (+52.33%)403.30 (+72.35%)257.50 (+14.90%)157.95 (+69.96%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)438.70 (n/a)273.06 (n/a)234.00 (n/a)224.10 (n/a)92.93 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-7.98%)0.02 (+0.48%)0.03 (+9.99%)0.01 (-21.29%)0.01 (+13.32%)773.90 (+27.06%)401.22 (+6.32%)283.60 (-9.10%)262.90 (+8.68%)218.47 (+49.12%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)609.10 (n/a)377.36 (n/a)312.00 (n/a)241.90 (n/a)146.51 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-14.36%)0.02 (+1.92%)0.02 (+2.90%)0.01 (+180.18%)0.01 (-45.24%)652.00 (-64.31%)480.16 (-31.74%)499.60 (-2.82%)302.60 (+16.74%)127.80 (-79.99%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1826.80 (n/a)703.40 (n/a)514.10 (n/a)259.20 (n/a)638.71 (n/a)
iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.11 (-1.38%)0.09 (+14.43%)0.10 (+15.68%)0.08 (+75.01%)0.01 (-48.77%)303.70 (-42.86%)266.94 (-18.33%)254.60 (-13.55%)229.40 (+1.41%)33.30 (-71.77%)
deb6e1e — 2026-09-03 22:38:330.11 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)531.50 (n/a)326.84 (n/a)294.50 (n/a)226.20 (n/a)117.97 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.17 (-2.05%)0.14 (-0.95%)0.15 (+4.72%)0.09 (-6.21%)0.03 (+11.33%)469.00 (+6.64%)312.48 (+2.44%)278.20 (-4.50%)238.20 (+2.10%)95.15 (+17.85%)
deb6e1e — 2026-09-03 22:38:330.18 (n/a)0.14 (n/a)0.14 (n/a)0.09 (n/a)0.03 (n/a)439.80 (n/a)305.04 (n/a)291.30 (n/a)233.30 (n/a)80.73 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (-2.62%)0.02 (+37.64%)0.02 (+54.98%)0.01 (+39.48%)0.00 (-32.31%)415.70 (-28.30%)296.76 (-32.42%)293.90 (-35.46%)236.30 (+2.69%)71.85 (-49.98%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)579.80 (n/a)439.12 (n/a)455.40 (n/a)230.10 (n/a)143.64 (n/a)
iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+12.41%)0.03 (-1.99%)0.03 (-13.63%)0.02 (-2.25%)0.01 (+8.12%)490.10 (+2.30%)333.20 (+2.23%)313.80 (+15.79%)198.50 (-11.07%)111.55 (-2.35%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)479.10 (n/a)325.92 (n/a)271.00 (n/a)223.20 (n/a)114.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.07 (+47.12%)0.04 (+16.59%)0.04 (-7.24%)0.02 (+5.92%)0.02 (+68.11%)521.10 (-5.58%)335.96 (-9.52%)320.90 (+7.83%)187.30 (-32.04%)131.50 (+9.17%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)551.90 (n/a)371.30 (n/a)297.60 (n/a)275.60 (n/a)120.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+45.87%)0.03 (+72.46%)0.03 (+71.31%)0.03 (+110.34%)0.01 (-7.94%)276.30 (-52.46%)244.74 (-44.28%)250.00 (-41.64%)192.60 (-31.43%)33.82 (-68.91%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)581.20 (n/a)439.26 (n/a)428.40 (n/a)280.90 (n/a)108.78 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.06 (+2.64%)0.03 (+8.50%)0.02 (+6.32%)0.02 (+25.08%)0.02 (+0.10%)601.40 (-20.05%)410.78 (-11.59%)463.00 (-5.93%)182.90 (-2.61%)190.50 (-19.70%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)752.20 (n/a)464.64 (n/a)492.20 (n/a)187.80 (n/a)237.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+47.07%)0.02 (+33.36%)0.02 (+16.92%)0.02 (+12.86%)0.01 (+100.86%)500.30 (-11.39%)376.28 (-21.07%)421.30 (-14.47%)222.80 (-32.01%)113.99 (+22.75%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)564.60 (n/a)476.72 (n/a)492.60 (n/a)327.70 (n/a)92.86 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (-13.79%)0.03 (-12.12%)0.02 (-31.74%)0.02 (+0.68%)0.01 (-18.93%)605.40 (-0.67%)425.22 (+8.80%)409.80 (+46.51%)258.60 (+16.02%)159.75 (-12.08%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)609.50 (n/a)390.82 (n/a)279.70 (n/a)222.90 (n/a)181.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (-22.39%)0.02 (-30.06%)0.02 (-42.84%)0.01 (-46.81%)0.01 (-12.99%)940.60 (+88.01%)502.70 (+57.90%)486.40 (+74.96%)210.40 (+28.92%)290.47 (+97.33%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)500.30 (n/a)318.36 (n/a)278.00 (n/a)163.20 (n/a)147.20 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.04 (+4.12%)0.02 (+15.56%)0.02 (-3.35%)0.01 (+60.55%)0.01 (+0.65%)645.70 (-37.71%)429.84 (-19.54%)482.80 (+3.47%)233.60 (-3.95%)166.65 (-43.84%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1036.60 (n/a)534.22 (n/a)466.60 (n/a)243.20 (n/a)296.73 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-37.46%)0.02 (-19.15%)0.02 (-23.94%)0.01 (-10.86%)0.01 (-45.54%)631.90 (+12.18%)372.68 (+15.17%)341.60 (+31.49%)265.00 (+59.93%)150.16 (-2.52%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)563.30 (n/a)323.58 (n/a)259.80 (n/a)165.70 (n/a)154.03 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (-30.18%)0.02 (+16.39%)0.03 (+54.16%)0.01 (+152.21%)0.01 (-49.63%)654.20 (-60.35%)433.68 (-37.61%)345.40 (-35.15%)320.40 (+43.23%)146.41 (-73.45%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1649.90 (n/a)695.12 (n/a)532.60 (n/a)223.70 (n/a)551.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.03 (+7.30%)0.02 (+19.87%)0.02 (+26.99%)0.02 (+25.91%)0.01 (+14.16%)502.90 (-20.59%)395.74 (-16.51%)374.70 (-21.26%)301.20 (-6.81%)95.91 (-12.84%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)633.30 (n/a)474.00 (n/a)475.90 (n/a)323.20 (n/a)110.04 (n/a)
iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.38 (+8.40%)0.23 (-21.85%)0.18 (-45.73%)0.17 (-8.43%)0.09 (+15.71%)573.20 (+9.20%)473.66 (+31.14%)537.20 (+84.29%)259.90 (-7.77%)133.64 (+21.63%)
deb6e1e — 2026-09-03 22:38:330.35 (n/a)0.29 (n/a)0.34 (n/a)0.19 (n/a)0.08 (n/a)524.90 (n/a)361.20 (n/a)291.50 (n/a)281.80 (n/a)109.88 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.41 (+38.52%)0.22 (+2.17%)0.19 (-7.07%)0.15 (-17.66%)0.11 (+128.54%)652.10 (+21.43%)503.52 (+8.21%)520.70 (+7.60%)238.60 (-27.81%)166.08 (+93.78%)
deb6e1e — 2026-09-03 22:38:330.30 (n/a)0.22 (n/a)0.20 (n/a)0.18 (n/a)0.05 (n/a)537.00 (n/a)465.30 (n/a)483.90 (n/a)330.50 (n/a)85.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.35 (-2.71%)0.23 (+9.68%)0.21 (+7.64%)0.09 (+131.67%)0.11 (-8.89%)1045.70 (-56.84%)530.96 (-34.88%)464.10 (-7.09%)282.10 (+2.77%)309.72 (-65.72%)
deb6e1e — 2026-09-03 22:38:330.36 (n/a)0.21 (n/a)0.20 (n/a)0.04 (n/a)0.12 (n/a)2422.70 (n/a)815.30 (n/a)499.50 (n/a)274.50 (n/a)903.57 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.35 (+18.80%)0.24 (+8.62%)0.26 (+8.23%)0.14 (-3.45%)0.08 (+35.81%)522.10 (+3.57%)338.86 (-4.16%)281.60 (-7.61%)210.80 (-15.81%)129.65 (+19.69%)
deb6e1e — 2026-09-03 22:38:330.29 (n/a)0.22 (n/a)0.24 (n/a)0.15 (n/a)0.06 (n/a)504.10 (n/a)353.58 (n/a)304.80 (n/a)250.40 (n/a)108.32 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.29 (-16.24%)0.21 (-2.45%)0.20 (+29.92%)0.12 (-1.77%)0.08 (-30.36%)608.90 (+1.81%)390.74 (-5.41%)375.70 (-23.03%)252.20 (+19.36%)150.59 (-17.12%)
deb6e1e — 2026-09-03 22:38:330.35 (n/a)0.22 (n/a)0.15 (n/a)0.12 (n/a)0.11 (n/a)598.10 (n/a)413.10 (n/a)488.10 (n/a)211.30 (n/a)181.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.40 (+39.73%)0.18 (+25.45%)0.15 (+16.19%)0.04 (-44.53%)0.13 (+58.13%)1883.00 (+80.28%)705.24 (+9.97%)495.80 (-13.94%)185.60 (-28.42%)671.41 (+130.79%)
deb6e1e — 2026-09-03 22:38:330.28 (n/a)0.14 (n/a)0.13 (n/a)0.07 (n/a)0.08 (n/a)1044.50 (n/a)641.28 (n/a)576.10 (n/a)259.30 (n/a)290.93 (n/a)
iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.44 (-9.51%)0.31 (-10.56%)0.25 (-14.47%)0.22 (+4.75%)0.10 (-23.13%)591.50 (-4.54%)466.72 (+7.63%)531.20 (+16.93%)295.70 (+10.50%)140.19 (-12.80%)
deb6e1e — 2026-09-03 22:38:330.49 (n/a)0.34 (n/a)0.29 (n/a)0.21 (n/a)0.13 (n/a)619.60 (n/a)433.62 (n/a)454.30 (n/a)267.60 (n/a)160.77 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.32 (-32.62%)0.23 (-31.07%)0.23 (-32.57%)0.12 (-42.63%)0.07 (-28.72%)1077.80 (+74.29%)621.84 (+49.19%)562.30 (+48.32%)410.30 (+48.39%)264.00 (+94.12%)
deb6e1e — 2026-09-03 22:38:330.47 (n/a)0.34 (n/a)0.35 (n/a)0.21 (n/a)0.10 (n/a)618.40 (n/a)416.80 (n/a)379.10 (n/a)276.50 (n/a)135.99 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.44 (-20.33%)0.33 (-16.10%)0.26 (-30.58%)0.25 (-2.66%)0.09 (-11.89%)518.90 (+2.73%)426.86 (+19.46%)502.10 (+44.07%)297.90 (+25.48%)111.81 (+13.81%)
deb6e1e — 2026-09-03 22:38:330.55 (n/a)0.39 (n/a)0.38 (n/a)0.26 (n/a)0.11 (n/a)505.10 (n/a)357.32 (n/a)348.50 (n/a)237.40 (n/a)98.24 (n/a)
iron/operators/strided_copy

test_strided_copy[chunked_transfer]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+19.38%)0.01 (+22.01%)0.01 (+35.07%)0.01 (+2.73%)0.00 (+44.43%)476.80 (-2.67%)321.50 (-14.88%)279.10 (-25.95%)213.90 (-16.22%)114.21 (+16.53%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)489.90 (n/a)377.72 (n/a)376.90 (n/a)255.30 (n/a)98.01 (n/a)

test_strided_copy[contiguous]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.01 (-0.58%)0.01 (-13.50%)0.01 (-7.91%)0.00 (-70.30%)0.00 (+48.16%)1887.40 (+236.67%)745.62 (+59.54%)526.60 (+8.60%)286.90 (+0.60%)646.43 (+489.59%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)560.60 (n/a)467.36 (n/a)484.90 (n/a)285.20 (n/a)109.64 (n/a)

test_strided_copy[four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+7.59%)0.01 (+20.09%)0.02 (+36.67%)0.01 (+12.28%)0.00 (+17.62%)493.10 (-10.94%)337.32 (-15.85%)267.60 (-26.83%)233.40 (-7.05%)123.08 (-5.91%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)553.70 (n/a)400.84 (n/a)365.70 (n/a)251.10 (n/a)130.81 (n/a)

test_strided_copy[kv_slot0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.52 (-16.37%)0.37 (-24.68%)0.41 (-17.50%)0.25 (-21.89%)0.12 (+3.21%)534.90 (+28.03%)385.04 (+37.13%)322.70 (+21.22%)256.20 (+19.61%)126.69 (+58.80%)
deb6e1e — 2026-09-03 22:38:330.62 (n/a)0.50 (n/a)0.50 (n/a)0.32 (n/a)0.11 (n/a)417.80 (n/a)280.78 (n/a)266.20 (n/a)214.20 (n/a)79.78 (n/a)

test_strided_copy[kv_slot5]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.54 (+4.56%)0.38 (+2.18%)0.34 (+14.79%)0.23 (-11.75%)0.13 (+2.48%)573.10 (+13.31%)379.94 (-1.16%)390.70 (-12.87%)243.90 (-4.35%)131.27 (+12.72%)
deb6e1e — 2026-09-03 22:38:330.52 (n/a)0.37 (n/a)0.29 (n/a)0.26 (n/a)0.12 (n/a)505.80 (n/a)384.38 (n/a)448.40 (n/a)255.00 (n/a)116.45 (n/a)

test_strided_copy[kv_slot5_four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.52 (-8.71%)0.41 (-10.33%)0.45 (-6.67%)0.24 (-12.19%)0.11 (+0.21%)545.20 (+13.89%)345.96 (+12.86%)294.00 (+7.14%)254.20 (+9.52%)118.15 (+20.34%)
deb6e1e — 2026-09-03 22:38:330.57 (n/a)0.46 (n/a)0.48 (n/a)0.28 (n/a)0.11 (n/a)478.70 (n/a)306.54 (n/a)274.40 (n/a)232.10 (n/a)98.18 (n/a)

test_strided_copy[kv_slot5_two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.55 (+20.37%)0.37 (-5.77%)0.30 (-29.42%)0.25 (-18.91%)0.13 (+113.13%)527.90 (+23.31%)388.94 (+14.37%)437.00 (+41.70%)241.50 (-16.95%)126.49 (+114.13%)
deb6e1e — 2026-09-03 22:38:330.45 (n/a)0.40 (n/a)0.43 (n/a)0.31 (n/a)0.06 (n/a)428.10 (n/a)340.06 (n/a)308.40 (n/a)290.80 (n/a)59.07 (n/a)

test_strided_copy[kv_slot_last]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.57 (+2.21%)0.43 (-6.43%)0.47 (-3.51%)0.26 (+2.41%)0.12 (+6.29%)504.80 (-2.36%)334.60 (+7.01%)279.40 (+3.64%)231.50 (-2.16%)111.54 (-3.24%)
deb6e1e — 2026-09-03 22:38:330.56 (n/a)0.46 (n/a)0.49 (n/a)0.26 (n/a)0.12 (n/a)517.00 (n/a)312.68 (n/a)269.60 (n/a)236.60 (n/a)115.27 (n/a)

test_strided_copy[two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+17.20%)0.01 (+18.23%)0.01 (+26.47%)0.01 (-19.17%)0.00 (+58.20%)709.50 (+23.71%)400.26 (-7.18%)312.10 (-20.93%)240.30 (-14.67%)194.80 (+62.90%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)573.50 (n/a)431.22 (n/a)394.70 (n/a)281.60 (n/a)119.59 (n/a)

test_strided_copy[two_channels_chunked]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.02 (+26.70%)0.01 (+36.02%)0.02 (+63.64%)0.01 (+3.04%)0.00 (+91.25%)449.30 (-2.96%)320.48 (-23.09%)265.20 (-38.89%)237.90 (-21.07%)98.81 (+48.50%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)463.00 (n/a)416.70 (n/a)434.00 (n/a)301.40 (n/a)66.54 (n/a)

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]

No metrics available.

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.00 (-57.14%)0.00 (-52.17%)0.00 (-60.00%)0.00 (+0.00%)0.00 (-82.18%)19032.66 (-11.13%)16854.88 (+42.97%)17780.70 (+128.53%)13023.78 (+127.90%)2308.45 (-69.22%)
deb6e1e — 2026-09-03 22:38:330.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)21415.50 (n/a)11789.16 (n/a)7780.39 (n/a)5714.62 (n/a)7500.24 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.00 (+7.69%)0.00 (-12.50%)0.00 (-16.67%)0.00 (-20.00%)0.00 (+13.39%)23136.21 (+30.10%)14890.66 (+18.29%)16092.63 (+8.11%)5798.17 (-4.59%)6753.21 (+24.63%)
deb6e1e — 2026-09-03 22:38:330.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)17782.76 (n/a)12587.83 (n/a)14885.21 (n/a)6077.00 (n/a)5418.64 (n/a)
iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:490.13 (-7.60%)0.10 (+7.12%)0.09 (+17.11%)0.07 (-4.77%)0.02 (-21.60%)30863.68 (+4.99%)22651.28 (-8.24%)22708.34 (-14.56%)15814.06 (+8.19%)5428.05 (-5.95%)
deb6e1e — 2026-09-03 22:38:330.14 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.03 (n/a)29397.45 (n/a)24686.08 (n/a)26578.49 (n/a)14617.47 (n/a)5771.46 (n/a)
iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:491.82 (-1.39%)1.21 (-10.82%)1.06 (-36.35%)0.52 (-26.26%)0.52 (-0.30%)1004.20 (+35.61%)523.74 (+16.94%)496.20 (+57.12%)287.90 (+1.41%)286.01 (+39.72%)
deb6e1e — 2026-09-03 22:38:331.85 (n/a)1.36 (n/a)1.66 (n/a)0.71 (n/a)0.52 (n/a)740.50 (n/a)447.88 (n/a)315.80 (n/a)283.90 (n/a)204.70 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:492.79 (-8.94%)2.01 (+2.67%)1.76 (+26.31%)1.69 (+23.72%)0.46 (-42.78%)620.80 (-19.17%)540.48 (-10.76%)595.90 (-20.83%)375.80 (+9.82%)103.00 (-51.64%)
deb6e1e — 2026-09-03 22:38:333.06 (n/a)1.96 (n/a)1.39 (n/a)1.37 (n/a)0.81 (n/a)768.00 (n/a)605.68 (n/a)752.70 (n/a)342.20 (n/a)213.00 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.58 (-2.67%)1.21 (+5.65%)1.29 (+41.89%)0.66 (-20.05%)0.38 (-2.53%)792.90 (+25.08%)479.12 (-3.80%)406.80 (-29.52%)331.10 (+2.76%)189.18 (+26.62%)
4bb8427 — 2026-06-23 22:46:491.63 (n/a)1.14 (n/a)0.91 (n/a)0.83 (n/a)0.38 (n/a)633.90 (n/a)498.02 (n/a)577.20 (n/a)322.20 (n/a)149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
33b4d18 — 2026-09-08 21:29:492.28 (+16.48%)1.46 (+10.13%)1.67 (+23.25%)0.65 (-19.68%)0.65 (+53.14%)807.40 (+24.50%)439.68 (+2.05%)313.80 (-18.87%)229.90 (-14.15%)236.56 (+66.80%)
deb6e1e — 2026-09-03 22:38:331.96 (n/a)1.32 (n/a)1.36 (n/a)0.81 (n/a)0.42 (n/a)648.50 (n/a)430.84 (n/a)386.80 (n/a)267.80 (n/a)141.82 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.75 (-15.44%)1.32 (-0.50%)1.36 (+22.47%)0.77 (-19.20%)0.36 (-21.75%)678.10 (+23.76%)430.02 (-0.09%)385.10 (-18.34%)300.10 (+18.29%)146.96 (+19.46%)
4bb8427 — 2026-06-23 22:46:492.07 (n/a)1.32 (n/a)1.11 (n/a)0.96 (n/a)0.46 (n/a)547.90 (n/a)430.40 (n/a)471.60 (n/a)253.70 (n/a)123.02 (n/a)
Phoenix - Examples

IRON

Tested on 2026_09_08_21_27_58 at commit 33b4d18.

Trends:

IRON Trends

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner
@hunhoffe hunhoffe Awaiting requested review from hunhoffe hunhoffe is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@andrej @asyms